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ABSTRACT 



The scores of students with disabilities who took the ACT 
Assessment at least twice, and at least once under extended- time guidelines, 
were studied. The investigation identified three groups of students. The 
first group was composed of 3,410 students who tested at least twice under 
extended- time guidelines. The second group of 3,439 students initially tested 
under standard- time limits and then retested under extended-time limits. The 
third group of 439 students initially tested under extended-time guidelines 
and retested under standard- time limits. Of the three groups of students, the 
second group had the largest average ACT Composite score gain of 3.2 scale 
score points. The third group of students had an average ACT Composite score 
decline of 0.6 scale score points. The first group had an average ACT 
Composite score gain of 0.9 scale score points, which is similar to that of 
students who tested twice under standard- time limits. Three appendixes 
contain the ACT Assessment extended-time guidelines, the request form for ACT 
special testing, and diagnosis, timing guidelines, and the test package 
legend for four of the study’s tables. (Contains seven tables and four 
references . ) (Author/SLD) 
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Abstract 



This study’s goal was to investigate the scores of students with disabilities who took 
the ACT Assessment at least twice, and at least once under extended-time guidelines. This 
investigation identified three distinct groups of students. The first group was composed of 
students who tested at least twice under extended-time guidelines. The second group of 
students initially tested under standard-time limits and then retested under extended-time 
guidelines. The third group of students initially tested under extended-time guidelines and 
retested under standard-time limits. Of the three groups of students, the second group had 
the largest average ACT Composite score gain of 3.2 scale score points. The third group of 
students had an average ACT Composite score decline of 0.6 scale score points. The first 
group had an average ACT Composite score gain of 0.9 scale score points, which is similar 
to that of students who tested twice under standard-time limits. 
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ACT Assessment Score Gains of Special-Tested 
Students Who Tested at Least Twice 

Since the introduction of the Enhanced ACT Assessment in the fall of 1989, the number of 
ACT students with disabilities testing under extended-time guidelines has increased almost 
threefold. The total volume (number of tests taken, not individual students) of tests administered 
under extended-time guidelines in 1989-90 was 8,519. For the 1995-96 testing year, the total 
volume of tests administered under extended-time guidelines rose to 23,463. During this period of 
time the percentage of tests adniinistered under extended-time guidelines has risen from slightly 
less than one percent of the total volume to approximately two percent of the yearly total tested 
volume. 

In response to this rapid growth in the number of students with disabilities pursuing higher 
education opportunities and, consequently, registering to take the ACT Assessment, ACT 
systematically implemented revisions to the test administration guidelines to accommodate the 
variety of diagnosed disabilities. For example, during the 1989-90 and 1990-91 academic years, the 
only guideline was that each test must be completed on one day. For the 1991-92 testing year, ACT 
provided a guideline to help individuals schedule test sessions of three hours per test. 

These earlier extended-time guidelines applied to all students approved for extended time, 
regardless of diagnosed disability or testing format (e.g., Braille, large print, audio cassette, etc). 
Beginning with the 1992-93 testing year, the extended-time guidelines were tailored to the testing 
format or package based upon analyses of actual time used by students over the past few years. 
Appendix A displays the modifications to the extended-time guidelines beginning with 1989 to the 
present. Appendix B provides a list of diagnoses/disabilities categories as well as avadlable test 
formats. 
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Students with documented disabilities, who request to test under extended-time, may 
request the test format most suitable to their particular needs when they register to take the ACT 
Assessment. The specific extended-time guideline assigned is then a function of the test format 
requested and the diagnosed disability. 

Not all students with documented disabilities request to test the first time under extended- 
time guidelines. Our study identified students with documented disabilities who initially tested 
under standard time limits, and then elected to retest under extended-time testing conditions. Our 
study also identified a group of students who initially tested under-extended time testing conditions, 
and for whatever reason(s), chose to retest under standard testing conditions. 

The purpose of this study was not to document the reasons students elected to retest and 
subsequently request a change in the mode of testing. Rather the study was designed to identify 
students with documented disabilities who tested at least twice, with at least one extended-time 
administration, to examine the various testing patterns, and to document the achievement results 
associated with these testing patterns by disability, test format, and extended-time guidelines. The 
motivating need for this study was and, for the most part, still is the current lack of information, 
both in the professional literature and unpublished manuscripts, regarding the achievement on 
college entrance exams of students with diagnosed disabilities. This problem is primarily due to the 
lack of data available for analysis. However, because of the steady increase in the number of college 
bound students electing to take the ACT Assessment under extended time, test data can now be 
aggregated across years to accumulate a sufficient number of records for study purposes. This 
increase may well be associated with the passage of the 1990 Americans with Disabilities Act, 
which has increased attention to the fair treatment of individuals with disabilities. 
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Data and Analysis 

The records of students from the 1992-93 through 1994-95 testing years were selected for 
analysis because across this three-year period the extended-time guidelines were consistent, and no 
changes or additions to the testing formats were made (refer to Appendix A). The total volume of 
tests administered with extended time during this period was 52,667. Of this total count, a subset of 
7,288 students with disabilities were identified who tested at least twice with at least one extended- 
time administration. Specifically, of this group of 7,288 students, 3,410 (Group I) individuals who 
initially tested under extended-time guidelines also retested under the same testing conditions. 
Group n (3,439 students) represents individuals who initially tested under standard time limits and 
then retested under extended-time guidelines. Group IH (439 students) represents individuals who 
initially tested under extended-time guidelines and then retested under standard time limits. 

The analysis of these three groups was conducted in the following manner. The initial test 
score distribution of ACT Composite scale scores was generated for each group. Similarly, the final 
distribution of ACT Composite scale scores was determined, and the average ACT Composite gain 
score, conditioned on the initial ACT Composite scale score, was calculated. In addition, for each 
scale score across the ACT scale score range (1 through 36), the percent of students scoring less 
than, equal to, and greater than their initial ACT Composite score was determined. Tables 1, 3 and 
5 summarize the distribution of scale score results for each of the three groups of students 
respectively. Tables 2, 4 and 6 display the summary of test results for each of the three groups 
broken down by diagnosed disability and extended-time guidelines. 

Because this study is limited to a self-selected group of individuals who took the ACT 
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Assessment at least twice and at least once under extended-time guidelines, the results cannot be 
generalized to all students with disabilities. 

Results and Discussion 

Group I Results 

Table 1 displays the average ACT Composite score achievement gains of students with 
disabilities who tested at least twice under extended-time guidelines broken down by initial test 
score, while Table 2 presents the achievement results for this group of students summarized by 
diagnosed disability, timing guideline and test package. Appendix C provides a legend of the 
diagnoses, timing guidelines, and a description of the testing packages referred to in Table 2 and in 
subsequent tables. Overall, the average gain across the scale score range for the ACT Composite 
for all students in this group was 0.9 scale score points. This is less than the standard error of 
measurement for the ACT Composite, which is 1.0 scale score point. Fifty-eight percent of Group I 
students (3,410) had a final ACT Composite scale score greater than their initial score. 

An examination of Table 2 reveals that students diagnosed with Attention Deficit Disorder 
(AD), who were given up to triple time on each of the four tests in the ACT Assessment battery and 
used the regular print version of the examination, had the highest final average ACT Composite 
score (19.5). Students diagnosed as Learning Disabled (LD) who were allowed up to three hours to 
complete each of the four tests and used the regular print version of the test along with an audio 
cassette had the lowest final average ACT Composite score of 16.9. Despite these relatively low 
average scores, all of the categories of students in Group I had a minimum average gain of 0.9 scale 
score points on the ACT Composite. 
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The overall average Composite score gain of 0.9 scale score points for Group I students is 
similar to the 0.7 scale score point average ACT Composite score gain for students who tested at 
least twice under standard conditions (Andrews & Ziomek, in press). 

Group II Results 

Tables 3 and 4 present the results for students with disabilities who initially tested under 
standard time limits and then retested under extended-time guidelines. These two tables are 
formatted in the same fashion as Tables 1 and 2. The average ACT Composite scale score gain for 
this group of students was 3.2 scale score points, a substantial improvement. Approximately 86% of 
the 3,439 students in this group had higher scores on retesting under extended-time guidelines 
(Table 3). Students diagnosed with Attention Deficit Disorder (AD) who had up to triple time to 
complete each of the four ACT Tests and used the regular print version had an average ACT 
Composite scale score gain of 4.7 scale score points. This subgroup of students had a final average 
ACT Composite score of 22.1, compared to an initial average ACT Composite score of 17.4 earned 
under standard time limits (Table 4). Similar to Group I students, the poorest performing students in 
Group n were the students diagnosed as Learning Disabled (LD). Although these students had an 
average ACT Composite scale score gain of 2.7 scale score points, their final average ACT 
Composite score, under extended-time guidelines was 17.8 scale score points (Table 4). 

Group III Students 

This group of students initially took the ACT Assessment under extended-time guidelines 
and elected, for reasons unknown, to retest under standard time limits. Group HI also had the fewest 
number of students (439) compared to the other two groups. 

The average ACT Composite scale score change for this group was -0.6 scale score points. 
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Only 27% of the students in this group had an increase of at least one scale score point in their ACT 
Composite scale score from initial testing under extended-time guidelines to retesting under 
standard time limits (Table 5). All categories of students in this group, regardless of diagnosis, 
timing guideline, or test package had the lowest final average ACT Composite scale scores 
compared to similar categories of students in the other two groups of testers (Table 6). 

Discussion 

This study’s primary goal was to investigate the achievement patterns of students with 
disabilities who took the ACT Assessment at least twice, and at least once under extended-time 
guidelines. As a result of this investigation, three distinct groups of students were identified. Group 
I students were students who took the ACT Assessment under extended-time guidelines at least 
twice. Group II students initially tested under standard time limits with the regular print version of 
the ACT Assessment, on one of the five national test dates, then subsequently tested under 
extended-time guidelines. Finally, Group III students took the ACT Assessment initially under 
extended-time guidelines and tested again under standard time limits. 

It should be noted that when students with disabilities request special testing, they indicate 
their diagnosis, provide documentation of the diagnosis and prior accommodations, and request the 
accommodation or test package they desire. Based upon the information provided by the student, 
ACT assigns the appropriate extended-time guideline for the test administration. The extended-time 
guidelines that have been established by ACT are based upon at least 90% of students with the 
same combination of test package and diagnosis finishing within that guideline. These guidelines 
are provided for planning and scheduling purposes and may be exceeded in individual cases. 

Table 7 presents a summary of the initial and final average ACT Composite scale scores for 
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the three groups of students by timing guideline and test package within diagnosis. In general. 
Group n students had lower initial average ACT Composite scores compared to the other two 
student groups; however, this group had the highest overall average gain and final average ACT 
Composite score. Within diagnosis and across all three student groups, students who were 
administered test package #4 (audio cassette plus regular print version) and were allowed up to 
three hours to complete each of the four tests (timing guideline #4), had lower initial and final 
average ACT Composite scores compared to students with similar diagnoses but different testing 
conditions. This performance may be associated with the "degree" of severity of the diagnosis, 
necessitated by the greater amount of time allowed to finish as well as the audio cassette 
accommodation. 

The results of this study raise two important and related questions. First, do students with 
disabilities benefit from taking the ACT Assessment under extended time? The answer to this 
question is an unequivocal “yes”. Group II students who initially tested under standard time limits 
and retested under extended-time guidelines had an average gain of 3.2 scale score points on the 
ACT Composite, three times the standard error of measurement for the ACT Composite, which is 
1.0 scale score units. Likewise, Group HI students who tested initially under extended-time 
guidelines and then retested under standard time limits, had their ACT Composite score drop, on 
average, by 0.6 scale score units. 

Second, what do these results suggest regarding the "flagging" of test scores of students 
who have been provided extended time as a testing accommodation? This issue is directly related to 
the concern over comparability of test scores between standard and nonstandard test 
administrations. Some historical context is necessary in order to address this question. 
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In 1977, the United States Department of Health, Education and Welfare developed 
regulations related to the implementation of Section 504 of the Rehabilitation Act of 1973 • These 
regulations specified that college admissions tests for individuals with disabilities be validated, and 
that the scores reflect what the test was intended to measure. A year later, the Department’s Office 
of Civil Rights issued an interim policy permitting test publishers to notify the recipients of student 
scores if a student was administered the test under nonstandard conditions. Test publishers could 
continue to “flag” student scores, until the comparability of test scores between standard and 
nonstandard test administrations could be established. 

This interim policy appears consistent with AERA/APA/NCME Standards 14.2 and 15.4 
(AERA, APA, NCME, 1985), with a “slight” exception; Standard 15.4 specifically excludes 
admissions tests when discussing cautions associated with nonstandard test administrations. This 
exception is most likely due to the fact that the Standards Committee was acknowledging the 
interim policy since the Standards postdate the inception of the policy. Nevertheless, the Standards 
Committee felt compelled to note that. 

Of all the aspects of testing people who have handicapping conditions, reporting test 
scores has created the most heated debate. Many test developers have argued that 
reporting scores from nonstandard test administrations without special identification 
(often called “flagging of test scores) violates professional principles, misleads test 
users, and perhaps even harms handicapped test takers whose scores do not 
accurately reflect their abilities. .... Until test scores can be demonstrated to be 
comparable in some widely accepted sense, there is little hope of happily resolving 
from all perspectives the issue of reporting scores with or without special 
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identification. Professional and ethical considerations should be weighed to arrive at 
a solution, either as an interim measure or as continuing policy (p. 78). 

In a planning paper prepared for the National Academy of Sciences Board of Testing and 
Assessment, William Mehrens (1997), concluded that, “After years of research, the profession has 
insufficient evidence to conclude the scores given [^/c] under non-standard administrations mean 
the same thing as scores obtained under standard administrative conditions” (p. 36). Willingham, 
Ragosta, Bennett, Braun, Rock, and Powers (1988) concluded that ‘The primary source of 
noncomparability that is directly associated with test scores is the extended time available in the 
nonstandard test administrations “ (p. 185). However, it seems reasonable to assume that extended- 
time accommodations will continue to be available, in order to insure that students with disabilities 
have sufficient time to complete the test. Given the conclusions of Mehrens and of Willingham, 
et.al., and given the large change in the average ACT Composite score for students who initially 
tested under standard-time limits and retested under extended-time guidelines, it is reasonable to 
conclude that the flagging of scores from nonstandard test administrations should be continued. 
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Test Year Extended Time Guideline 



1989- 90 

1990- 91 

1991- 92 

1992- 93 



1993- 94 

1994- 95 

1995- 96 



1996- 97 

1997- 98 



Up to one day per test 

same as 1989-90 

Up to three hours per test 

Regular or large print materials : 

Timing guideline 2 = Up to double time for 
the English and Mathematics tests, and up 
to triple time for the Reading and 
Science Reasoning tests 
Timing guideline 3 = Up to triple time for 
each test 

Cassette, braille, and script readers: 

Timing guideline 4 = Up to three hours per 
test 

same as 1992-93 
same as 1992-93 

Regular or large print materials : 

Timing guidelines 2 and 3 same as preyious 
three years 

Cassette, braille, and script readers: 

Timing guideline 4 = Up to three hours for 
English, Reading, and Science Reasoning 
tests and up to four hours for the 
Mathematics test. 

same as 1995-96 

same as 1995-96 
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1996-97 REQUEST FORM FOR ACT ASSESSMENT SPECIAL TESTING 

(To Be CoMPLETiD By Supervisor) 

Please type or print clearly 

INCOMPLETE AND/OR UNSIGNED FORMS WILL BE RETURNED, UNPROCESSED 

A. STUDENT INFORMATION B. SUPERVISOR’S MAILING INFORMATION 



Last Name 


First Name 


Middle Initial Name 












House Number 


Street 


Apartment Number 








Institution 




City 


state 


ZIP Code 






Street Address and Post Office Box Number 




Social Security Number 




Date of Birth — r— ^ 

City State 


ZIP Code 


High School or College Currently Attending 


Country Of outside U.S.) 

/ 








Area CodeAelephone Number (daytime) 


Fax Number 



Date of Previous ACT Special Testing 



C. 



D. 



PROPOSED DATE OF TESTING (September 1. 1996-June 30. 1997) — 

A minimum of 60 days must elapse between repeat testings for a student. Requests must be received at least four weeks before pro- 
posed test date (6 weeks far students outside the United States) to allow far reviewing of requests and shipping of materials. Requests 
postmarked Offer June L 1997 will be returned. 



DIAGNOSIS/DISABILITY (Check all that apply.) 

Learning Disability cod 

{ I (DA) Developmental Arithmetic Disorder 

I I (OY) Developmental Reading Disorder (Dyslexia) 

I I (DW) Developmental Writing Disorder 
{ I (ld) Other Learning Disability (explain on side 2) 

Psychological/Mental Disability (os) 

I I (AD) Attention Deficit Disorder 
I I (AX) Anxiety Disorder 

I I (PO) Other Psychoiogical/Mental Disability (explain on side 2) 



Physical/Sensory Disability (02) 

I I (df) Hearing Impairment 
I I (PH) Motor Impairment 
I I (VI) Visual Impairment 
□ OR) Tourettes Syndrome 
I I (EP) Epilepsy or Seizures 

Other Disability (o?) 

I I (HB) Confined to the home (explain on side 2) 
|~] (OD) (explain on side 2) 



E. TEST FORMAT REQUESTED (Must check one or request will be returned, unprocessed.) 

Q (00 Regular Type Q Cassette with Regular Type Q (07) Reader's Script with Regular Type 

Q ( 02 ) Large Type O ( 05 ) Cassette with Large Type Q (08) Reader's Script with Large Type 

I I (03) Braille (printed copy included) | I ( 06 ) Cassette with Raised Line/Braille Q (OO) Reader's Script with Raised Line/Braille 

' — ' — Tables and Illustrations Tables and Illustrations . 



F. E>aENDED TIME REQUESTED Q Yes Q No 

G. OTHER ACCOMMODATIONS REQUESTED (Explain) 



Note: The authorized timing code and approval/denial of test formats will app>ear 
urxier the student's rome on the Test Materials Distribution List. 



Side 1 

O 



ERIC 



THIS FORM MAY BE DUPUCATED AS NEEDED. 



(Completion of Side 2 required for all requests.) 
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Diagnosis, Timing Guidelines, and Test Package 
Legend For Tables 2, 4 and 6. 
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Timing Guidelines 



Standaxd Times: English Test 

Mathematics Test 

Reading Test 

Science Reasoning Test 



45 minutes 
60 minutes 
35 minutes 
35 minutes 



Timing Guideline #2 = up to double time on the English and 

Mathematics tests, and up to triple time 
for the Reading and Science Reasoning 
tests 

Timing Guideline #3 = up to triple time for each of the four 

tests 



Timing Guideline #4 



up to three hours for each of the four 
tests 



Test Package 

Package 1 = regular print version 

Package 4 = audio cassette plus regular print 
version 



Diagnosis 

Attention Deficit (AD) 

Dyslexia (DY) 

All other Learning Disabilities (LD) 
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